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Description 

Automated Stereoscopic Image 
Acquisition and Storage System 

Background of the Invention 

The present invention relates to a stereoscopic 
image acquisition and storage system for acquiring an 
image mosaic suitable for photogrammetric analysis. 
The production of stereoscopic images is well 
5 known in the art and usually involves the use of two 
cameras which record the same scene from different 
perspectives. Conventionally, such images have been 
obtained by mounting two cameras on a bar with a fixed 
separation between them, the cameras being angled 
10 slightly toward each other to acquire overlapping 

images. The bar is rotated by hand and, as needed, the 
angles of the cameras with respect to each other are 
changed manually in order to converge to a greater or 
lesser degree for closer or more remote subjects. 
15 However, such handheld systems are not useful for 
preparing mosaics where precise control of image 
overlap is required. For example, within the camera 
convergence area it may be desirable to trace a 
polyhedron, i.e., a series of flat surfaces tangent to 
20 the radii of a sphere. In some cases, the bar is 

rotated automatically and the picture-taking is timed 
to produce a series of still-frame images of the scene. 
Typically such systems still suffer from image 
distortion. Moreover, when a mosaic is prepared, the 
25 exposure of various image segments differs somewhat, 
causing an undesirable variation in the composite. 

In addition, such systems do not provide for 
automated control of camera exposure time. The cameras 
are often fitted with exposure meters which control the 
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exposure time as a function of the light levels and the 
sensitivity of the image recording medium. The 
exposure time is adjusted in accordance to the average 
amount of light falling on the area of interest. Thus, 
5 it is not possible to acquire several images of a given 
scene with different exposure times automatically 
adjusted to shadows or glare . 

Finally, annotation of images using such systems 
is very limited, i.e., usually restricted to frame 
10 numbers within a roll of film or a video tape. Thus, 

careful external records must be maintained in order to 
keep track of where, and when, the images were 
acquired . 

The Kennedy Patent No. 4,431,290 discloses a 
15 portable photogrammetry system using two cameras 
mounted at opposite ends of a handheld bar and 
corresponding flash units which are actuated 
simultaneously to assure that the images recorded by 
the cameras are taken at the same time. in this case, 

2 0 the cameras are fixed on the bar with their lens axes 

parallel and cannot be rotated toward or away from each 
other and the camera bar must be moved manually in 
horizontal and vertical planes to obtain a mosaic of 
overlapping images . 

25 The Hines Patent No. 4,650,305 discloses a camera 

mounting apparatus in which one of two cameras mounted 
on a support plate is angularly adjustable to change 
the convergence between the camera axes. The nodal 
point of the lens for the adjustable camera is placed 

30 on a line joining two pivot posts by which the camera 
support plate is linked to a. pair of individually 
adjustable sliders. The pivoting motion of the camera 
takes place about another point which is movable in 'a 
slot. spaced from a line on which the nodal point is 

35 disposed. 



wo 94/10604 



-3- 



PCr/US93/10107 



The Nardate et al. Patent No. 5,084,763 discloses 
a system for obtaining and handling stereoscopic video 
signals, but does not disclose any support arrangement 
providing relative motion for two cameras by which 
5 video signals are obtained. 

The Barker Patent No. 3,608,457 and Handler Patent 
No, 3,731,607 disclose stereoscopic camera arrangements 
in which a single camera is moved to successive lateral 
positions along a support bar to obtain stereoscopic 
10 images. In both of these patents, the camera is 

pivoted about a point corresponding to the location of 
the object being photographed. 

Summary of the Invention 

15 Accordingly, it is an object of the present 

invention to provide an automated stereoscopic image 
acquisition and storage system which overcomes the 
above-mentioned disadvantages of the prior art. 

It is another object of the present invention to 

2 0 provide an automated stereoscopic image acquisition and 
storage system which minimizes image distortion and 
allows precise control of image mosaic geometry. 

These and other objects of the invention are 
attained by providing an automated stereoscopic image 

25 acquisition and storage system including a camera 

mounted for rotation about the principal node of the 
camera lens. Preferably the system includes a control 
arrangement for orientation of the camera for all 
images of an object being photographed, and desirably, 

30 it also uses an image intensity histogram for 

determining the number of phptographs of. varying 
exposure to be taken to assure reproduction of all 
aspects of the object being photographed. PreferabTy 
the system includes a pair of identical cameras mounted 

35 in spaced relation on a camera support arrangement, 
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along with an indexing assembly for each of the cameras 
and for the camera support arrangement. 

Brief Description of the Drawings 
5 Further objects and advantages of the present 

invention will be more fully appreciated from a reading 
of the following detailed description when considered 
in connection with the accompanying drawings wherein: 
Fig. 1 is a perspective pictorial view 
10 illustrating a typical embodiment of a camera support 
and control arrangement in accordance with the 
invention ; 

Fig, 2 is an enlarged side view showing a 
representative camera positioning structure for use in 
15 the arrangement shown in Fig, 1; 

Fig, 3 is a schematic block diagram illustrating a 
typical- embodiment of a stereoscopic image acquisition 
storage control system in accordance with the 
invention; and 

2 0 Fig, 4 is a schematic block diagram showing the 

details of another representative system controller for 
use in the invention. 

Detailed Description of Preferred Embodiments 
2 5 In the representative embodiment of the invention 

shown in Fig. 1, a stereoscopic imaging apparatus 
includes two identical still frame digital video 
cameras 10 and II supported in spaced relation on a 
support bar 12 by corresponding indexing head 
30 assemblies 13 and 14. Each indexing head rotating 

assembly has one rotational stage 15 for. rotating the 
supported camera through an azimuthal angle about a 
vertical axis 16 and another rotational stage 17 for 
rotating the camera about a horizontal axis 18. If 
35 desired, each camera can be rotated independently. 

Each camera is positioned on a mounring plate 19 so 
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that both of the axes 16 and 18 pass through the 
principal node 20 of the camera lenses 21 and 22, 
respectively. The indexing head assemblies 13 and 14 
may incorporate conventional commercially available 
5 equipment which permits computer control and resolution 
to one thousandth of a degree so as to meet image 
accuracy requirements for less computationally 
intensive photogrammetric analysis. 

The cameras 10 and 11 are provided with positive 

10 locking aperture control and focussing systems so that 
both cameras can be set at identical focus and exposure 
conditions. Preferably, the camera lenses 21 and 22 
are selected such that one camera pixel corresponds to 
0,03 inch square or less at a distance of six feet from 

15 the camera in object space. Camera lenses suitable for 
photogrammetric analysis include metric or fixed focus 
lenses. Alternatively, a variable focus lens locked 
into a fixed position may also be used. In this case 
the same clamping device that locks the focus typically 

2 0 also locks the lens aperture setting. The focal length 
of each variable focus lens is fixed for a particular 
image acquisition activity- In order to satisfy depth 
of field requirements, the camera lens aperture is 
typically closed down to f/11 or f/16- The focal 

2 5 lengths and apertures of both cameras are fixed at the 
same values for each series of images, thus the same 
depth of field and field width are obtained in all of 
the images facilitating photogrammetric analysis. 
Suitable cameras for photogrammetric analysis include 

30 Videk cameras available from Eastman Kodak Corporation 
in Rochester, New York fitted with Nikon. . lenses . 

An enlarged side view of the camera indexing 
arrangement is illustrated in Fig. 2. The camera 
support bar 12 is mounted on a motorized rotational 

35 stage 2 3 arranged to rotate the camera bar through an 
azimuthal angle about a vertical axis 24 passing 
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through the center of the bar, A motorized goniometric 
cradle 25 mounted on the rotational stage 2 3 is 
arranged to move the camera bar about a horizontal axis 
26 (Fig. 1) which passes through the principal node 20 
5 of the camera by tilting the camera bar 12 about the 
axis 26 through an angle 27 of up to sixty degrees as 
shown in Fig. 1. Except for the azimuthal rotation of 
the bar 12, all movement of the camera bar and thus of 
the cameras, occurs about the principal node- If 
10 necessary, a slide plate (not shown) can be disposed in 
between the camera mounting plate 19 and the camera 
rotational stage 15 for alignment of the camera so as 
to more precisely locate the principal node 17 of the 
lens at the center of rotation, 
15 The camera bar indexing arrangement is attached to 

a tripod (not shown) through a tripod mounting plate 
28, The tripod should be capable of rigidly holding 
the camera bar, indexing head assembly, and flood 
lights or strobe lights and should also have hand- 
20 leveling capability and be adjustable in height. 

As shown by the system control diagram illustrated 
in Fig. 3, indexing equipment 30, such as the indexing 
arrangements 13, 14, 23 and 25 shown in Fig. l, 
mechanically linked to the cameras 10 and 11 is 
25 arranged to control the orientation of both cameras for 
appropriate stereo image capture as directed by a 
system controller 31. The system controller 31 also 
controls the camera exposure time by actuating 
mechanical or electronic shutters in the camera. In 
30 addition, for fixed lens systems having a variable 

aperture, the lens apertures are also set by the system 
controller. Synchronization for strobe lights mounted 
on the cameras (not shown) is also provided by the - 
system controller . 
3 5 The system controller 31 includes a portable 

computer 3 2 containing a conventional microprocessor, 
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preferably comprising an Intel 386 CPU available from 
Intel Corporation, California arranged in a 
conventional manner to control an image frame grabber 
33, a digital tape storage device 34, and a temporary 
5 storage device 35, all controlled by input signals from 
an operator station 36. These components can be 
assembled into a single package used by an operator to 
control the system. The operator station 3 6 includes a 
video monitor 37 which receives images from the frame 

10 grabber 3 3 to monitor camera image quality, and a 
computer monitor and keyboard station 3 8 with a 
standard keyboard • 

The frame grabber 33, which is internal to the 
system controller, simultaneously obtains and 

15 temporarily stores images from each of the cameras 10 
and 11, thereafter sending them sequentially to the 
digital data storage device 34. A suitable frame 
grabber is available from Matrox Corporation in Dorval, 
Quebec, Canada. 

2 0 The digital data storage device 34 in the system 

controller 31, which collects, catalogs and stores 
image data, may be a tape, CD ROM or any other suitable 
device for storing the image data for subsequent 
photograminetric analysis. An administrative header for 

25 each image including location, camera position data, 
date and time, exposure time, focal length, and any 
other desired annotations can be entered on the tape 
via the keyboard unit 38. 

A typical embodiment of a system controller is 

30 shown in detail in the block diagram of Fig, 4, In 
that illustration, an operator station 40 includes a 
keyboard 41, a computer monitor 42, and a video monitor 
43 arranged to receive images from the two cameras 10 
and 11 selectively through a video selector switch 44 

35 and corresponding frame grabbers 45 and 46. In 

addition, a motion controller 47 and a motor driver 48 
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supply appropriate signals to the indexing head 
assemblies shown in Fig. 1. The motion controller and 
motor driver are of the type available from 
Newport/Klinger Corporation. 
5 The typical control system shown in Fig. 4 also 

includes separate mass memory devices controllers 4 9 
and 50 for supplying appropriate camera image signals 
to corresponding digital tape recording devices 51 and 
52 as well as a disk controller 53 communicating with a 
10 hard disk device 54 and a floppy disk device 55, all 
under the control of a computer 56. 

Although an operator manually initializes the 
camera positions, the entire stereoscopic imaging 
apparatus is automatically controlled by the computer 
15 56, as illustrated in Fig. 4. The computer 56, through 
the motion controller 47 and motor driver 48, directs 
the movement of the indexing head assemblies to 
generate data in accordance with the type of 
photogrammetric analysis that is to be performed. An 
20 image intensity histogram, calculated by computer, is 
used to determine the number of images to be acquired 
at differing exposures in a given direction in order to 
elicit details that may otherwise be hidden in shadows 
and glare. The number of images and exposure time can 
25 be set manually by the operator, or automatically by 
the computer, based on the histogram values of the 
reflected light from one or more objects of interest. 

The computer collects the obtained images from 
each camera 10 and 11 through the frame grabbers 4 5 and 
3 0 46. In this manner, a sequence of stereo images with 

known convergence angles and. specified image overlap is 
obtained. In addition, the image from either of the two 
frame grabbers is selected by the video selector 
selector switch 44 and displayed on the video monitor 
35 43. The video monitor display thus provides real time 



wo 94/10604 PCT/US93/10107 

-9- 



visual confirmation of correct camera location and 
exposure to the operator. 

The computer 56 stitches together or combines the 
images collected from each frame grabber 4 5 and 4 6 to 
5 form a composite left and right image and directs the 
composite images through the memory device controllers 
49 and 50 connected to the digital tape devices 51 and 
52, The computer 56 also supplies information to and 
receives information from two disks, the hard disk 54 

10 and the floppy disk 55 via the disk controller 53. 

In an alternate embodiment (not shown) , a single 
camera is mounted on a translation stage which in turn 
is mounted onto the camera bar 12- Under computer 
control the camera is then moved from one end of the 

15 bar 12 to the other, and is pivoted at specified angles 
about the lens nodal point. In this manner a single 
camera may provide data usually obtained by two 
separate cameras. Of course, the time required to 
acquire the desired imagery in this manner is at least 

2 0 twice as long as when two separate cameras are used. 
In addition, use of a single camera may result in a 
loss in precision since the camera takes pictures at 
different times v/ith different weight distributions on 
the camera bar. Nevertheless, the use of such a 

25 stereoscopic imaging apparatus results in a reduction 

in cost, not only due to the use of a single camera but 
also a reduction of associated control equipment. 

In a second alternate embodiment, two cameras may 
be mounted on separate tripods using gimbal systems to 

30 pivot the cameras about the lens nodal points in an 
appropriate manner. By pointing and tilting the 
cameras using standard leveling techniques prior to the 
start of the image acquisition process, a camera plane 
is established which serves as the baseplane for 

35 recording camera pointing data. 



wo 94/10604 



-10- 



PCr/US93/10107 



Although the invention has been described herein 
with reference to specific embodiments, many 
modifications and variations therein will readily occur 
to those skilled in the art. Accordingly, all such 
5 variations are included within the intended scope of 
the invention- 
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Claims 

1 1. A method of acquiring an image mosaic suitable for 

2 photogrammetric analysis comprising the steps of: 

3 providing at least one camera having an 

4 objective lens for focusing light from a scene 

5 onto an image plane, and 

6 moving the camera to different orientations 

7 with respect to the scene to produce a series of 

8 still-frame images of the scene wherein the center 

9 of camera motion is coincident with the principal 

10 node of the camera lens, thereby minimizing image 

11 distortion. 

1 2. A method of acquiring an image mosaic suitable for 

2 photogrammetric analysis according to claim 1 

3 wherein the camera is mounted on a motorized 

4 rotational stage. 

1 3. A method of acquiring an image mosaic suitable for 

2 photogrammetric analysis according to claim 2 

3 including the step of controlling camera motion by 

4 an indexing head assembly directed by a system 

5 controller , 

1 4. A method of acquiring an image mosaic suitable for 

2 photogrammetric analysis according to claim 3 

3 wherein the system controller comprises a 

4 microprocessor, an image frame grabber, a storage 

5 device, and an indexing head controller, and 

6 including the steps of simultaneously obtaining 

7 and temporarily storing images from the camera by 

8 the frame grabber and the storage device in 

9 response to signals from the microprocessor. 
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1 5. A method of acquiring an image mosaic suitable for 

2 photogrammetric analysis according to claim 3 

3 including the step of controlling the camera 

4 exposure by directing movement of the shutter in 

5 response to signals from the system controller. 

1 6. Stereoscopic imaging apparatus comprising: 

2 at least one camera . having an objective lens 

3 for focusing light from a scene onto an image 

4 plane; and 

5 means for controlling motion of the camera 

6 about the principal node of the objective lens. 



1 7. Stereoscopic imaging apparatus according to claim 

2 6 further comprising an indexing head assembly for 

3 controlling the means for controlling motion of 

4 the camera about the principal node of said camera 

5 lens. 

1 8. Stereoscopic imaging apparatus according to claim 

2 7 further comprising system control means for 

3 controlling the indexing head assembly. 

1 9. Stereoscopic imaging apparatus according to claim 

2 8 wherein the system control means comprises a 

3 microprocessor^ image frame grabber means, digital 

4 storage means, and indexing head control means and 

5 wherein the indexing head control means directs 

6 the indexing head assembly to control motion of 

7 the camera, the frame grabber means simultaneously 

8 obtains and temporarily .stores images from the 

9 camera and thereafter transmits the images to the 
10 digital storage means. 



1 10. 

2 



Stereoscopic imaging apparatus comprising camera 
support means, a pair of cameras supported in 
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3 spaced relation by the camera support means, each 

4 of the cameras having a lens with a nodal point, 

5 and camera position control means for each of the 

6 cameras arranged to impart angular motion to the 

7 cameras about the nodal points of the lenses, 

1 11. Stereoscopic imaging apparatus comprising camera 

2 support means, a pair of- cameras mounted on 

3 separate camera support means, each of the cameras 

4 having a lens with a nodal point, and common 

5 camera position control means for each of the 

6 cameras arranged to impart angular motion to the 

7 cameras about the nodal points of the lenses. 

1 12. Stereoscopic imaging apparatus comprising camera 

2 support means, a camera having a lens with a nodal 

3 point supported by the camera support means, and 

4 camera position control means arranged to impart 

5 angular motion to the camera about the nodal point 

6 of the lens. 

1 13 . Stereoscopic imaging apparatus according to claim 

2 10, 11 or 12 including position control means for 

3 the camera support means arranged to impart motion 

4 to the camera support means about an axis 

5 extending through the nodal point of both camera 

6 lenses. 

1 14. Stereoscopic imaging apparatus according to claim 

2 13 wherein the position control means for the 

3 camera support means is also arranged to impart 

4 motion to the camera support means about an axis 

5 perpendicular to the axis extended through the - 

6 nodal points. 
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1 15. Stereoscopic imaging apparatus according to claim 

2 10, 11 or 12 including control means comprising 

3 microprocessor means for controlling the camera 

4 position control means and operation of the camera 

5 and camera image storage means for storing images 

6 obtained by the camera and supplied to the control 

7 means. 

1 16. Stereoscopic imaging apparatus according to claim 

2 15 including display means for displaying images 

3 obtained by the camera means, 

1 17. Stereoscopic imaging apparatus according to claim 

2 15 wherein the control means controls the 

3 operation of the camera to produce a mosaic of 

4 stereoscopic images of a scene. 

1 18. Stereoscopic imaging apparatus according to claim 

2 15 wherein the control means controls the 

3 operation of the camera to obtain successive 

4 images of a scene at different exposures in 

5 accordance with an image intensity histogram. 
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